- Recap Pilot 1
- Recap Study 1: bad characters
- Pilot 2
- Study 2: good characters
- Study 3: both good and bad
- Study 4: good characters
- Study 5: both good and bad (between subjects)
16 May 2022
Developing materials
6 descriptions:
MTurk sample, N = 212, (female = 80, male = 128, non-binary = 1, prefer not to say = 1, Mage = 36.6, SD = 10.3).
Imagine a person named Sam. Throughout their life they have been known to be cruel, act unfairly, and to betray their own group.
Imagine a person named Robin. Throughout their life they have been known to physically hurt others, treat some people differently to others, and show lack of loyalty.
Imagine a person named Francis. Throughout their life they have been known to violate the standards of purity and decency, show lack of respect for authority, and treat people unequally.
Imagine a person named Alex. Throughout their life they have been known to cause others to suffer emotionally, to deny others their rights, and to cause chaos or disorder.
(adapted from Grizzard et al., 2020)
Imagine a person named Jackie. They have red hair, play tennis four times a month, and have one older sibling and one younger sibling.
Imagine a person named Charlie. They are left-handed, drink tea in the morning, and have two older siblings and one younger sibling.
A paired samples t-test revealed a significant difference in moral Perception between the Diagnostic Condition, (M = 56.54, SD = 28.56), and the Non-Diagnostic condition, (M =72.97, SD = 13.89), t(211) = -8.735, p < .001, d = 0.6.
A paired samples t-test revealed a significant difference in moral Perception between the Diagnostic Condition, (M = 4.4, SD = 175), and the Non-Diagnostic condition, (M = 5.39, SD = .98), t(211) = -8.655, p < .001, d = 0.59.
## ## Error: ResponseId ## Df Sum Sq Mean Sq F value Pr(>F) ## Residuals 211 2215 10.5 ## ## Error: ResponseId:condition ## Df Sum Sq Mean Sq F value Pr(>F) ## condition 1 274.6 274.56 74.92 1.27e-15 *** ## Residuals 211 773.3 3.66 ## --- ## Signif. codes: 0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1 ## ## Error: ResponseId:scenario_abb ## Df Sum Sq Mean Sq F value Pr(>F) ## scenario_abb 4 2.3 0.5746 1.487 0.204 ## Residuals 844 326.2 0.3865
Imagine a person named Sam. Throughout their life they have been known to be cruel, act unfairly, and to betray their own group.
Imagine a person named Robin. Throughout their life they have been known to physically hurt others, treat some people differently to others, and show lack of loyalty.
Imagine a person named Francis. Throughout their life they have been known to violate the standards of purity and decency, show lack of respect for authority, and treat people unequally.
Imagine a person named Alex. Throughout their life they have been known to cause others to suffer emotionally, to deny others their rights, and to cause chaos or disorder.
They have red hair, play tennis four times a month, and have one older sibling and one younger sibling.
They are left-handed, drink tea in the morning, and have two older siblings and one younger sibling.
UL Students with a total sample of N = 801, (female = 496, male = 283, non-binary/other = 17, prefer not to say 3, Mage = 26.2, SD = 10.2).
## numDF denDF F-value p-value ## (Intercept) 1 2396 2180.9685 <.0001 ## condition 1 2396 47.1470 <.0001 ## scenario 3 2396 156.7080 <.0001 ## condition:scenario 3 2396 2.0149 0.1098
## numDF denDF F-value p-value ## (Intercept) 1 2396 10208.623 <.0001 ## condition 1 2396 53.278 <.0001 ## scenario 3 2396 304.146 <.0001 ## condition:scenario 3 2396 0.997 0.3933
Developing materials
6 descriptions:
MTurk sample, N = 215, (female = 63, male = 152, non-binary = 0, prefer not to say = 0, Mage = 36.6, SD = 9.6).
Imagine a person named Sam. Throughout their life they have been known to always help and care for others, treat everyone fairly and equally, and show a strong sense of loyalty to others.
Imagine a person named Robin. Throughout their life they have been known to show compassion and empathy for others, act with a sense of fairness and justice, and, never to break their word.
Imagine a person named Francis. Throughout their life they have been known to uphold the standards of purity and decency, show respect for authority, and to always act honestly and fairly.
Imagine a person named Alex. Throughout their life they have been known to protect and provide shelter to the weak and vulnerable, uphold the rights of others, and show respect for authority.
Imagine a person named Jackie. They have dark hair, go for a jog twice a week, and their favourite colour is blue.
Imagine a person named Charlie. They have blue eyes, drink coffee in the morning, and their favourite colour is green.
A paired samples t-test revealed a significant difference in moral Perception between the Diagnostic Condition, (M = 56.54, SD = 28.56), and the Non-Diagnostic condition, (M =72.97, SD = 13.89), t(211) = -8.735, p < .001, d = 0.6.
A paired samples t-test revealed a significant difference in moral Perception between the Diagnostic Condition, (M = 4.4, SD = 175), and the Non-Diagnostic condition, (M = 5.39, SD = .98), t(211) = -8.655, p < .001, d = 0.59.
## ## Error: ResponseId ## Df Sum Sq Mean Sq F value Pr(>F) ## Residuals 214 849.8 3.971 ## ## Error: ResponseId:condition ## Df Sum Sq Mean Sq F value Pr(>F) ## condition 1 41.89 41.89 42.33 5.38e-10 *** ## Residuals 214 211.78 0.99 ## --- ## Signif. codes: 0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1 ## ## Error: ResponseId:scenario_abb ## Df Sum Sq Mean Sq F value Pr(>F) ## scenario_abb 4 1.94 0.4850 2.98 0.0185 * ## Residuals 856 139.33 0.1628 ## --- ## Signif. codes: 0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
Imagine a person named Sam. Throughout their life they have been known to always help and care for others, treat everyone fairly and equally, and show a strong sense of loyalty to others.
Imagine a person named Robin. Throughout their life they have been known to show compassion and empathy for others, act with a sense of fairness and justice, and, never to break their word.
Imagine a person named Francis. Throughout their life they have been known to uphold the standards of purity and decency, show respect for authority, and to always act honestly and fairly.
Imagine a person named Alex. Throughout their life they have been known to protect and provide shelter to the weak and vulnerable, uphold the rights of others, and show respect for authority.
They have dark hair, go for a jog twice a week, and their favourite colour is blue.
They have blue eyes, drink coffee in the morning, and their favourite colour is green.
DV1: Moral perceptions scale, 7-point Likert; 4 items: Bad-Good, Moral-Immoral, Violent-Peaceful, Merciless-Empathetic; Cronbach’s alpha = 0.85
DV2: Single item of moral perception; 0-100 slider scale; Very Immoral-Very Moral
Total sample of N = 820, (female = 466, male = 337, non-binary/other = 15, prefer not to say 4, Mage = 29, SD = 10.9).
The majority of participants were from the student body: n = 533, (female = 370, male = 147, non-binary/other = 14, prefer not to say 3, Mage = 25.5, SD = 9.6).
In order to reach our pre-registered target sample size we recruited additional participants from MTurk: n = 287, (female = 96, male = 190, non-binary/other = 1, prefer not to say 1, Mage = 35.7, SD = 10.1).
## numDF denDF F-value p-value ## (Intercept) 1 2453 35258.06 <.0001 ## condition 1 2453 0.52 0.4691 ## scenario 3 2453 24.46 <.0001 ## condition:scenario 3 2453 0.92 0.4282
## numDF denDF F-value p-value ## (Intercept) 1 2453 36236.50 <.0001 ## condition 1 2453 0.02 0.8883 ## scenario 3 2453 54.49 <.0001 ## condition:scenario 3 2453 0.44 0.7243
## Warning in rm(x, y, y1, y2, y3, z): object 'x' not found
Imagine a person named Sam. Throughout their life they have been known to always help and care for others, treat everyone fairly and equally, and show a strong sense of loyalty to others. (CFL)
Imagine a person named Robin. Throughout their life they have been known to show compassion and empathy for others, act with a sense of fairness and justice, and, never to break their word. (CFL)
Imagine a person named Alex. Throughout their life they have been known to be cruel, act unfairly, and to betray their own group. (CFL)
Imagine a person named Francis. Throughout their life they have been known to physically hurt others, treat some people differently to others, and show lack of loyalty. (CFL)
DV1: Moral perceptions scale, 7-point Likert; 4 items: Bad-Good, Moral-Immoral, Violent-Peaceful, Merciless-Empathetic; Cronbach’s alpha = 0.94
DV2: Single item of moral perception; 0-100 slider scale; Very Immoral-Very Moral
MTurk sample of N = 874, (female = 320, male = 550, non-binary/other = 4, prefer not to say 2, Mage = 36.4, SD = 10.7).
## numDF denDF F-value p-value ## (Intercept) 1 2619 16705.051 <.0001 ## condition 1 2619 0.005 0.9413 ## valence 1 2619 1377.694 <.0001 ## condition:valence 1 2619 2.684 0.1015
## Warning: Converting "ResponseId" to factor for ANOVA.
## $ANOVA ## Effect DFn DFd F p p<.05 ges ## 2 condition 1 873 0.03610554 8.493419e-01 1.340084e-06 ## 3 valence 1 873 512.45355672 1.242389e-89 * 2.542259e-01 ## 4 condition:valence 1 873 16.61251479 5.002870e-05 * 6.637092e-04
## numDF denDF F-value p-value ## (Intercept) 1 2619 21396.991 <.0001 ## condition 1 2619 0.001 0.9750 ## valence 1 2619 1327.693 <.0001 ## condition:valence 1 2619 1.430 0.2318
## Warning: Converting "ResponseId" to factor for ANOVA.
## $ANOVA ## Effect DFn DFd F p p<.05 ges ## 2 condition 1 873 0.00669487 9.348069e-01 2.336129e-07 ## 3 valence 1 873 494.20162281 4.103959e-87 * 2.393100e-01 ## 4 condition:valence 1 873 8.60784490 3.434814e-03 * 3.388382e-04
## numDF denDF F-value p-value ## (Intercept) 1 873 2273.1467 <.0001 ## condition 1 873 6.9807 0.0084
## Warning: Converting "ResponseId" to factor for ANOVA.
## $ANOVA ## Effect DFn DFd F p p<.05 ges ## 2 condition 1 873 6.98073 0.00838666 * 0.0004408043
## $diagnostic ## mean sd min max len ## 1 4.019451 2.09108 1 7 874 ## ## $`non-diagnostic` ## mean sd min max len ## 1 4.08095 2.013616 1 7 874
## numDF denDF F-value p-value ## (Intercept) 1 873 3603.748 <.0001 ## condition 1 873 3.513 0.0612
## Warning: Converting "ResponseId" to factor for ANOVA.
## $ANOVA ## Effect DFn DFd F p p<.05 ges ## 2 condition 1 873 3.513295 0.06121202 0.0002246037
## $diagnostic ## mean sd min max len ## 1 4.019451 2.09108 1 7 874 ## ## $`non-diagnostic` ## mean sd min max len ## 1 4.08095 2.013616 1 7 874
## numDF denDF F-value p-value ## (Intercept) 1 873 28302.926 <.0001 ## condition 1 873 12.042 5e-04
## Warning: Converting "ResponseId" to factor for ANOVA.
## $ANOVA ## Effect DFn DFd F p p<.05 ges ## 2 condition 1 873 12.0419 0.0005456622 * 0.001700532
## $diagnostic ## mean sd min max len ## 1 5.905034 1.061668 1.75 7 874 ## ## $`non-diagnostic` ## mean sd min max len ## 1 5.846682 1.025843 1.5 7 874
## numDF denDF F-value p-value ## (Intercept) 1 873 30756.813 <.0001 ## condition 1 873 6.848 0.009
## Warning: Converting "ResponseId" to factor for ANOVA.
## $ANOVA ## Effect DFn DFd F p p<.05 ges ## 2 condition 1 873 6.847735 0.00902883 * 0.000781429
## $diagnostic ## mean sd min max len ## 1 5.905034 1.061668 1.75 7 874 ## ## $`non-diagnostic` ## mean sd min max len ## 1 5.846682 1.025843 1.5 7 874
## [1] 507
DV1: Moral perceptions scale, 7-point Likert; 4 items: Bad-Good, Moral-Immoral, Violent-Peaceful, Merciless-Empathetic; Cronbach’s alpha = 0.81
DV2: Single item of moral perception; 0-100 slider scale; Very Immoral-Very Moral
MTurk sample of N = 856, (female = 347, male = 507, non-binary/other = 2, prefer not to say 1, Mage = 37.1, SD = 11).
## numDF denDF F-value p-value ## (Intercept) 1 2561 34256.32 <.0001 ## condition 1 2561 4.53 0.0334 ## scenario 3 2561 3.29 0.0199 ## condition:scenario 3 2561 2.73 0.0426
## numDF denDF F-value p-value ## (Intercept) 1 2561 41094.11 <.0001 ## condition 1 2561 2.21 0.1372 ## scenario 3 2561 3.56 0.0137 ## condition:scenario 3 2561 0.87 0.4542
DV1: Moral perceptions scale, 7-point Likert; 4 items: Bad-Good, Moral-Immoral, Violent-Peaceful, Merciless-Empathetic; Cronbach’s alpha = 0.97
DV2: Single item of moral perception; 0-100 slider scale; Very Immoral-Very Moral
MTurk sample of N = 1750, (female = 858, male = 879, non-binary/other = 12, prefer not to say 8, Mage = 37.8, SD = 15.8)..
## numDF denDF F-value p-value ## (Intercept) 1 1746 10616.659 <.0001 ## condition 1 1746 0.206 0.6499 ## valence 1 1746 977.372 <.0001 ## condition:valence 1 1746 9.633 0.0019
## numDF denDF F-value p-value ## (Intercept) 1 1746 16699.127 <.0001 ## condition 1 1746 0.014 0.9066 ## valence 1 1746 1004.460 <.0001 ## condition:valence 1 1746 5.451 0.0197
## numDF denDF F-value p-value ## (Intercept) 1 858 1459.2939 <.0001 ## condition 1 858 2.1923 0.1391
## $diagnostic ## mean sd min max len ## 1 3.631675 2.212024 1 7 412 ## ## $`non-diagnostic` ## mean sd min max len ## 1 3.80971 2.031748 1 7 448
## numDF denDF F-value p-value ## (Intercept) 1 858 2654.2173 <.0001 ## condition 1 858 1.5136 0.2189
## $diagnostic ## mean sd min max len ## 1 3.631675 2.212024 1 7 412 ## ## $`non-diagnostic` ## mean sd min max len ## 1 3.80971 2.031748 1 7 448
## numDF denDF F-value p-value ## (Intercept) 1 888 28872.505 <.0001 ## condition 1 888 19.177 <.0001
## $diagnostic ## mean sd min max len ## 1 6.252921 0.8393273 1 7 428 ## ## $`non-diagnostic` ## mean sd min max len ## 1 6.07197 0.8701416 2.75 7 462
## numDF denDF F-value p-value ## (Intercept) 1 888 46132.44 <.0001 ## condition 1 888 9.94 0.0017
## $diagnostic ## mean sd min max len ## 1 6.252921 0.8393273 1 7 428 ## ## $`non-diagnostic` ## mean sd min max len ## 1 6.07197 0.8701416 2.75 7 462
## $diagnostic ## mean sd min max len ## 1 87.19718 13.37093 50 100 213 ## ## $`non-diagnostic` ## mean sd min max len ## 1 81.98667 16.90348 0 100 225
## ## Welch Two Sample t-test ## ## data: x$M1 by x$condition ## t = 3.5877, df = 422.8, p-value = 0.0003726 ## alternative hypothesis: true difference in means between group diagnostic and group non-diagnostic is not equal to 0 ## 95 percent confidence interval: ## 2.355838 8.065195 ## sample estimates: ## mean in group diagnostic mean in group non-diagnostic ## 87.19718 81.98667
## $diagnostic ## mean sd min max len ## 1 6.228873 0.8492642 1 7 213 ## ## $`non-diagnostic` ## mean sd min max len ## 1 6.031111 0.8836491 2.75 7 225
## ## Welch Two Sample t-test ## ## data: x$R_tot by x$condition ## t = 2.3883, df = 435.9, p-value = 0.01735 ## alternative hypothesis: true difference in means between group diagnostic and group non-diagnostic is not equal to 0 ## 95 percent confidence interval: ## 0.03501707 0.36050719 ## sample estimates: ## mean in group diagnostic mean in group non-diagnostic ## 6.228873 6.031111
## ## Wilcoxon rank sum test with continuity correction ## ## data: x$M1 by x$condition ## W = 28388, p-value = 0.000766 ## alternative hypothesis: true location shift is not equal to 0
## ## Wilcoxon rank sum test with continuity correction ## ## data: x$R_tot by x$condition ## W = 27368, p-value = 0.009167 ## alternative hypothesis: true location shift is not equal to 0
## $diagnostic ## mean sd min max len ## 1 87.02791 14.13814 0 100 215 ## ## $`non-diagnostic` ## mean sd min max len ## 1 83.44726 14.8576 22 100 237
## ## Welch Two Sample t-test ## ## data: x$M1 by x$condition ## t = 2.6247, df = 448.96, p-value = 0.008969 ## alternative hypothesis: true difference in means between group diagnostic and group non-diagnostic is not equal to 0 ## 95 percent confidence interval: ## 0.8995724 6.2617268 ## sample estimates: ## mean in group diagnostic mean in group non-diagnostic ## 87.02791 83.44726
## $diagnostic ## mean sd min max len ## 1 6.276744 0.8306588 2 7 215 ## ## $`non-diagnostic` ## mean sd min max len ## 1 6.110759 0.8571856 4 7 237
## ## Welch Two Sample t-test ## ## data: x$R_tot by x$condition ## t = 2.0896, df = 448.03, p-value = 0.03721 ## alternative hypothesis: true difference in means between group diagnostic and group non-diagnostic is not equal to 0 ## 95 percent confidence interval: ## 0.009877705 0.322091680 ## sample estimates: ## mean in group diagnostic mean in group non-diagnostic ## 6.276744 6.110759
## ## Wilcoxon rank sum test with continuity correction ## ## data: x$M1 by x$condition ## W = 29142, p-value = 0.007704 ## alternative hypothesis: true location shift is not equal to 0
## ## Wilcoxon rank sum test with continuity correction ## ## data: x$R_tot by x$condition ## W = 28622, p-value = 0.02105 ## alternative hypothesis: true location shift is not equal to 0
## $diagnostic ## mean sd min max len ## 1 42.02791 35.9883 0 100 215 ## ## $`non-diagnostic` ## mean sd min max len ## 1 46.97235 34.05101 0 100 217
## ## Welch Two Sample t-test ## ## data: x$M1 by x$condition ## t = -1.4665, df = 428.22, p-value = 0.1432 ## alternative hypothesis: true difference in means between group diagnostic and group non-diagnostic is not equal to 0 ## 95 percent confidence interval: ## -11.571240 1.682353 ## sample estimates: ## mean in group diagnostic mean in group non-diagnostic ## 42.02791 46.97235
## $diagnostic ## mean sd min max len ## 1 3.598837 2.272306 1 7 215 ## ## $`non-diagnostic` ## mean sd min max len ## 1 3.842166 2.046233 1 7 217
## ## Welch Two Sample t-test ## ## data: x$R_tot by x$condition ## t = -1.1692, df = 424.52, p-value = 0.243 ## alternative hypothesis: true difference in means between group diagnostic and group non-diagnostic is not equal to 0 ## 95 percent confidence interval: ## -0.6523885 0.1657312 ## sample estimates: ## mean in group diagnostic mean in group non-diagnostic ## 3.598837 3.842166
## ## Wilcoxon rank sum test with continuity correction ## ## data: x$M1 by x$condition ## W = 21254, p-value = 0.1098 ## alternative hypothesis: true location shift is not equal to 0
## ## Wilcoxon rank sum test with continuity correction ## ## data: x$R_tot by x$condition ## W = 21624, p-value = 0.188 ## alternative hypothesis: true location shift is not equal to 0
## $diagnostic ## mean sd min max len ## 1 44.79695 35.12557 0 100 197 ## ## $`non-diagnostic` ## mean sd min max len ## 1 46.74892 33.7386 0 100 231
## ## Welch Two Sample t-test ## ## data: x$M1 by x$condition ## t = -0.5835, df = 409.65, p-value = 0.5599 ## alternative hypothesis: true difference in means between group diagnostic and group non-diagnostic is not equal to 0 ## 95 percent confidence interval: ## -8.527947 4.624020 ## sample estimates: ## mean in group diagnostic mean in group non-diagnostic ## 44.79695 46.74892
## $diagnostic ## mean sd min max len ## 1 3.667513 2.14951 1 7 197 ## ## $`non-diagnostic` ## mean sd min max len ## 1 3.779221 2.022015 1 7 231
## ## Welch Two Sample t-test ## ## data: x$R_tot by x$condition ## t = -0.55066, df = 406.27, p-value = 0.5822 ## alternative hypothesis: true difference in means between group diagnostic and group non-diagnostic is not equal to 0 ## 95 percent confidence interval: ## -0.5104988 0.2870827 ## sample estimates: ## mean in group diagnostic mean in group non-diagnostic ## 3.667513 3.779221
## ## Wilcoxon rank sum test with continuity correction ## ## data: x$M1 by x$condition ## W = 21867, p-value = 0.487 ## alternative hypothesis: true location shift is not equal to 0
## ## Wilcoxon rank sum test with continuity correction ## ## data: x$R_tot by x$condition ## W = 21906, p-value = 0.5058 ## alternative hypothesis: true location shift is not equal to 0
There is a convincing effect for bad characters when they are contrasted against other bad characters. But this effect shrinks (or disappears) when they are contrasted against good characters.
There is a convincing effect for good characters when there is no contrast, or when they can be contrasted against bad characters; but this disappears (or shrinks) when other good characters are the only contrast.